This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the apphcant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

P REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



t 




PCX WORU) Pffm mVAL fTOPBTT^ 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TOEATY (PCT) 



1 (51) Ittterattfcwl Pitnt Oai 






(U)lDtBra 


itkwl PiibUatkn Number: WO 961/34494 


H04N 7/173 




Al 












(43)lBtcni 


itkMMl PubUatioo Ditc: 31 October 1996 (31.10.96) 



(21) 

(22) Itttcrmtiaial FlUog Ditr. 



PCr/US96D490i 
9 April 1996 (09J0496) 



(30) Priority Dtt: 
08/429,109 



26 April 1995 OBMSS) 



US 



(71) AppOcnt: WINK OOMMUNICATKM^S, INC [USAJS]: 1001 
Marina vmage Piricway, Alameda, OA 94501 (US). 



(72) bradan: DOUGHERTY, firian. P4 122 
Alameda, OA 94502 (US). DEL SESTO, 
AfmltacB SM. Alameda, CA 94502 (USX 



Read, 

1082 



(74) Afeata: OOTUEB. Chariet. E ec aL; tawick 4k West LLP^ 
Suite 60a Two Palo Alto Square, Palo AUo, CA 94306 
(US). 



(81) 



StBtfK AU AH AT, AU, A2, BB. BO, BR, BY, 
CA, CH, CN, CZ. re, DK, EE, ES. FL OB, OE, HU, IS, 
JP, KE Ka KP. KR, K2. UC LR, LS, LT, LU, LV. MD, 
MO. MK, MN, MW, MX, NO, NZ. PU PT, RO, RU, SD, 
SE Sa SI, SK, TJ, TM. TR. TT. UA. Ua U2, VN, ARffO 
paiem (XE L5, MW, SD, SZ. 00), Eurtun pateat (AM, 
AZ, BY, KO. K2, MD, RU, 77, TM). European patent (AT, 
BE CH, DE DK, ES, a PR, OB, OR, IE IT, LU, MC, 
NL FT. SE), OAPI patent (BP. BJ, CP, CO, O, CM, OA, 
ON, ML, MR, NE SN, TD, TO). 



PobUilMd 

With 



mumatuMtai swek rtpcft 



(54)nia: METHOD AND APPARATUS PGR ROUHNO CONFIDENTIAL MORMATION 
(57) 



A method and appantui ramet taa infonnatian indndlQg '^'*^ %\ (ntemattoo and other 
infonnation to a vendor to a lecare oianner without requiring the okt to tmomlt infomation in a lecure 
roanoer. llie uaer pravidea a uaer ideadlkr and htfonnatiaa inchidlnf coofl^^ 
coUector. who relatea tbt naer ideodflcr to Ae uaer in far maik au The mpooe collector may ytrify the 
tnfdrmationto praect agatnit taid. An inftmnatioo provider providea an appiicatian Uentlfler and vendor 
routiBi infbfmatfton to a reaponae coOector, who lelatea the veito rootiaf infoimidon to die appUcatfon 
idendte. Tlie app li rari o n ideadfler eontapcnding to die vendor ia braodcaat to d» uaer via an i tt tmf m ti ^ 
infonnation lyttem appUcitta, and die tateraetive infooudon ayatem aenda die application idendfler, a 
uaer ident ifier and other reapooae hifannatta to a itaponae ooOector ai directed by die uaer and die 
imei itUve infonna tioo ayitera app ii c a ti oa. Hie reaponae collector may diea taam die uaer'a infonnation 
and other reaponae infonnadon to die vendor aocotdiaf to die vendor nudng Informadon. Ibe ukt may 
aend anonymous ir ap onatt In die aame manner without aeading die uaer ideadfler to dzs itaponae collector. 




FOR TBS FUVOSBS OF WFOMMATION ONLY 



Coda laed to Ideatify Sattt pvty to the PCT on te ftont pacn of puspUett poblishinf imEnntioBal 
■ppUctsloat under the per. 




wo 9604494 



PCTA3S96/04904 



METHOD AND APPARATUS FOR ROUTING CONFIDENTIAL INFORMATION 

Related Applications 

The subject matter of this application is related to the subject matter of the following 
S applications: q>plication serial number AAAA, entitled, "COMPACT GRAPHICAL 

INTERACTIVE INFORMATION SYSTEM", and appUcation serial number BBBB. entiUed 
"METHOD AND APPARATUS FOR DETERMINING BROADCASTER INFORMATION", 
each of the above applications filed by Brian R Dougherty and Eric E Del Sesto on i^ril 25, 
1995, having the same assignee as the present invention and incorporated herein by reference in 
10 their entirety* 

Field of Invention 

The present inventim relates to broadcast and receiving systems, and more specifically, 
to interactive broadcast and receiving systems. 

Backpnund of Invention 

1 5 Interactive inf onnation systems allow an information provider to broadcast information 

to a user, and in some cases allow a user to send a response to a vendor. The user may receive 
the information on a wide variety of devices, such as a pager, cellular telephone, personal digital 
assistant or a television. An interactive information system on which the user receives the 
information using a television is called an interactive television system. 

20 Some interactive information systems insot and extract data into unused lines in the 

Vertical Blanking Interval, or VBI, of the conventional television transmission for decoding by a 
set*top device. The VBI is a portion of the television picture which is broadcast, but not 

« 

typically seen by the television viewer, and readily allows for insertion of data, such as closed 
captioning text The VBI can provide an inexpensive tran^ort for transmitting data to a user, 
25 but not for transporting data from a user, for example to allow a user to order goods or services 
from a vendor. 

Other communication methods provide inexpensive conununication between a user and a 
vendor. For example, communication between a user and a vendor via modem-coupled 
telephone lines such as internet lines can provide a relatively inexpensive way to communicate. 

30 However, to provide a convenient interface to order goods or services from a vendor, the user 
must be able to ccmuminicate confidential information such as a credit card number or other 
payment information to the vendor. Inexpensive conununication lines may not be suitably secure 
to allow a user to convenientiy and inexpensively conununicate confidential information to a 
vendor via an interactive information system. 

35 In addition, to enhance the convenience of ordering goods or services via an interactive 

information system, the system should automatically route ordering and user information to the 
p roper vendor. Because some interactive information systems use low-bandwidth transports, it is 
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helpful to send as Uttle infonnation to the user as possible. Thus a compact method of sending 

routing information is desirable. 

Some, user-responses require anonymity to ensure accuracy, such as responses to a user 
questionnaire. Thus, it is desirable to allow anonymous responses to be sent via an interactive 
information system. 



^Stimmarv i 

apparatus allows informal 
proper 



user to send confidential information over unsecure conununication Unes. 
10 An interactive infonnation system appUcation is assigned an application identifier which 

is transmitted to die user with Ae interactive information system application. The application 
identifier is sent to a response collector, which performs the fimction described below, along 
with routing information to describe die routing of responses to a vendor who wiU process them. 
A user may be assigned one or more identifiers, one corresponding to the user equipment 
15 used to send and receive interactive information, and another identifier to allow the identification 
of a specific individual if more than one individual wUl use die user equipment These 
identifiers and odier information, indudmg confidential infonnation such as a credit card number 
are sent by the user to a response collector via an interactive infonnation system for use as 
described below. If desired, the response collector may verify the infonnation. such as ensuring 
20 that the user's stated address matches the credit card billing address. 

An interactive infonnation system application containing die application identifier is 
broadcast to the user. To submit a response such as an order using die interactive infonnation 
system application, die user instnicts die interactive infonnation system to transmit die 
application identifier, one or more user identifiers and odier response infonnation such as model 
25 number and quantity to a response collector over a communication line. Because no coofidenual 
infonnation is sent, inexpensive, unsecure communication lines may be used by die user to 
communicate witfi die response collector. TTie response coUector assembles die user's 
infonnation including confidential infonnation and sends it to die vendor via die rouung 
infonnation associated widi die application identifier. Because only die appUcation identifier is 
30 sent to die user, die system is compatible widi low-bandwiddi transports, yet automatically routes 

user responses to a vendor for processing. 

Some responses do not include die user identifiers to allow users to send anonymous 

responses via die interactive iniformation system. 




35 




. 1 is an illustration of a conventional television screen displaying a conventional 
televisiOT^^gram widi a graphical interactive infonnation system application displayed 
according to one embodiment of die present invention. 



2 
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Hgure 2A is a block schematic diagram of a provider component apparams according to 
one embodiment of the present invention. 

Hgure 2B is a block schematic diagram of a reception component apparams according to 
one embodhnmt of the present invention. 
5 Hgnxt 2C is a block schematic diagram of a provider component apparatus according to 

an alternate embodiment of the present mvention. 

Figure 2D is a block diagram of developers and information providers according to one 

embodiment of the present invention. 

Figure 3 is a block schematic diagram of user equipment according to one embodiment of 
10 the present invention. 

Hgure 4 is a flowchart ilhistrating a method of one embodiment of the present invention. 

Figure 5 is a block diagram representing a format of an qyplication header record 
according to one embodiment of the present invention. 

Figure 6 is a block diagram representing a format of a form definition record according to 
IS one embodiment of the present invention. 

Rgure 7A is an ilhistratim of a conventional television display with a form according to 
one embodiment of tbc present invention. 

Hgure 7B is a block diagram representing a format of a form object definition record 
according to one embodiment of the present invention. 
20 Hgure 8 is a block diagram representing a format of a button object definition record 

according to one embodiment of the present invention. 

Hgure 9 is a block diagram representing a format of a text object definition record 
according to one embodiment of the presoit invention. 

Hgure 10 is a block diagram representing a format of a bitmap object definition record 
2S according to one embodiment of the present invention. 

Hgure 11 is a block diagram representing a format of a list object definition record 
accordmg to cme embodincent of the present invention. 

Hgure 12 is a block diagram representing a format of a timer object definition record 
according to one embodiment of the present invention. 
30 Hgure 13 is a block diagram representing a format of a picture object definition record 

according to one embodiment of the present invention. 

Hgure 14A is a block diagram representing a format of a resource definition record 
according to one embodiment of the present invention. 

Hgure 14B is a block diagram representing a format of a text resource according to one 
35 embodiment of the present invention. 

Hgure 14C is a block diagram representing a fmnat of a bitmap resource according to 
one embodiment of the present invention. 

Hgure 14D is a block diagram representing a format of a picture resource according to 
one embodiment of the present invention: 

3 
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Figure 14E is a block diagram representing a fonnat of a picture resource element 
accoixiing to one embodiment of the present invention. 

Figure 14F is a block diagram representing a format of a resource Ust according to one 

iment of the present invention. 

Rgure 14G is a block diagram representing a format of a resource Ust element accoiding 
to one embodiment of the present invention. 

Figure 15 is a block diagram representing a format of an update recorti according to one 

embodiment of the presem invention. 

Figure 16 is a block diagram representing a format of an interactive icon defmition record 

1 0 according to one embodiment of the present invention. 

Figure 17A is a block diagram representing a format of a script execute record 
to one embodiment of tfw present invention. 

Figure 17B is a block diagram representing a foraut of a script resource according to one 

embodiment of die present invention. 
15 Figure 18A is a flowchart Ulustrating a method of broadcasting a broadcaster mformauon 

table according to tiie present invention. 

Figure 18B is a flowchart Ulustraiing a method of Receiving a broadcaster mformauon 
table accordmg to the present invention. .^««..ki^ 

Rgure 18C is a flowchart iHustnting a medwd of using a broadcaster mformanon table 

20 according to the present invention. 

Figure 19 is a flowchart illustrating a method of drawing a form on a display according to 



the present invcntioa. 

Figure 20 is a flowchart illustrating a method of drawing an object on a display according 

to the present invention. 
25 Figure 21 is a flowchart iUustrating a method of drawing a resource on a display 

accortting to the present invention. .... 

Figure 22 is a block diagr»n representing a format of a response record accordmg to one 

embodiment of the present invention. 

Figure 23 is a block schematic diagram Ulustrating a response network accordmg to one 

30 embodiment of *e present invention. 

Figure 24 is a flowchart Ulustrating a method of allowing a user to use an unsccure 
communication Une to send confidential information to an order processor according to the 
present invention. , 

r?ttai]fid pg'^^^T tiffn 9i ^ ^^^^^ Embodimsat 



Referring now to Rgure 1. a s«nple graphical interactive television system application 
display is shown A display screen 110 of a conventional television 112 displays a convenuonal 
television show which contains a politician 114 giving a speech. A graphical interactive 
information system application form 116 having a border 130 is displayed by the graphical 
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interactive television system on the screen 110 of the television 112. The fonn 116 may contain 
text descriptions 126, 128 and pictures or icons 120, 122 corresponding to buttons 118, 124 to 
allow the user to make a selecticm by pressing a nunwric key using a conventional television 
remote control device. When the user indicates a selection by pressing a remote control key 
corresponding to a button 118, 124, a new form may be displayed containing additional 
information relating to tfie indicated selection. In one embodiment, one or more selections may 
cause the grq)hical interactive television system to send response information to a response 
collector which may or may not be the mformation provider. For example, button 118 can allow 
the user to make a $2S campaign contribudon to the candidate 114. If during the broadcast 
program a second candidate follows the first candidate 114, an identical form 116 may be 
displayed related to information or a response collector different from that relating to the first 
candidate 114. 

Gr^hical mteractive information is communicated to the user by broadcasting gr^hical 
interactive information system applications. A gr^hical interactive mformation system 
qyplicadon is a set of definitions, comnumds, scripts and data which may be used to produce a 
gr^hical user mterface, determme how a user may control the grq)hical interactive information 
system application and external devices and control and defirtt response information. Gr^hical 
mteractive applications nuiy be broadcast to correspond to other information broadcast, such as 
in the example of Rgure 1 above. When the gr^rtiical interactive qjplication is broadcast to 
correspond to a broadcast program, it is called a program plication. When the graphical 
interactive iq>plication is broadcast to correspond to an advertisement, it is called an 
advertisement application. A graphical interactive application may be broadcast which does not 
relate to a broadcast program or advertisement, and such an plication is called a graphical 
virtual interactive channel. For example, with a gr^hical interactive television system, a 
program listing guide Cfr weather information may be broadcast independently of the odier 

broadcast programs. Because of die flexibility of the system, any form of infonnation may be 
broadcast 

n. Hflffdwam. 

Referring now to Figures 2A and 2B, two components, a provider component 206 and a 
reception component 234, are used to implement a graphical interactive information system in 
accordance with the present invention. The provider component 206 allows the.generadon and 
broadcast of the graphical interactive information system q[>plication, and the reception 
component 234 allows for the reception, decoding, control and display of the graphical 
interactive information system application. The present invention allows the provider 
component 206 to define the display and control of a graphical interactive information system 
application to be displayed on the recqition component 234 without requiring the high 
bandwidth normally associated with interactive information systems which display a graphical 
user interface. The provider component 206 compresses the graphical interactive information 
system educations by isolating only the information needed to allow the reception component 
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gr^cal user interface and by encapsulating 
ise of this graphical a|q)iication compression a 




required to broadcast ine appucanon. i nc grapiuwu interactive information 

system application is broadcast to die reception component 234. which is able to reproduce a 
complete graphical interactive information application from the small amount of infonnauon 
receives from the provider component 206 phis its own resident inteUigence. 




Hie provider component 206 inserts and broadcasts graphical interactive information 
system appUcations onto a broadcast signal. In one embodiment, a conventional broadcast signal 
10 is provided by signal provider 208. In one embodiment, signal provider 208 is a program 

generator. In another embodiment, signal provider 208 is a video signal source from a live feed. 
In another embodiment, signal provider 208 is a video signal from a video storage device, such 

as 8 video tape recmder. 

The provider component 206 also contains a graphical interactive compact protocol 
15 generator and formatter 210. A graphical interactive compact protocol generator and formatter 
210 is used by an information provider to generate the interactive information system 

information to be broadcast In one embodiment, the graphical interactive compact protocol 
generator and formaner 210 is a conventional 486 personal computer system with a stored 
program for operation as described below. The graphical interactive compact protocol generator 

20 and formatter 210 generates the compact protocol, described below, in response to commands 
provided to it by an information provider. In one embodiment, the infoimation provider types m 
the compact protocol bytes which wiU represent the graphical user interface as described below. 
In another embodiment, a visual interface is used to allow a form designer to design forms and 
irarocdiately see how they will appear. Tlie graphical interactive compact protocol generator and 

25 formatter 210 translates and formats the form appearing on the computer screen of the graphical 

interactive compact protocol goicraior and formatter 210 into die compaa protocol descnbed 
below. In another embodiment, the graphical interactive compact protocol generator and 
formatter 210 receives assigmnent of attribute commands such as forml .border.color = red. and 
generates the proper compact protocol commands as described below. 

30 A compact protocol inserter 212 inserts the compact protocol from the compact protocol 

generator 210 into the broadcast medium, "n* broadcast medium is the frequency spectrum used 
to cany the compact protocol. In one embodiment, the graphical interactive information system 
is a graphical interactive television system, the broadcast medium is a standard North American 
tele^ signd according to NTSC standards, and the vertical blanking interval, or VBI. is used 

35 as a transport to broadcast die compact protocol. A transport is the specific portion of die 
brtjadcast medium which will carry the compact protocol. 

In one embodiment, conventional methods are employed to insert data into the VBI of a 
conventional bn«dc«t ftom a broadcast device. The North American Bn>adcast Teletext 
Standard EIA.506. OSI layers M. defines die mediods and p«)tocols for sending dau in one or 
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more lines of the VBL In one embodiment, the conventional TDS-3 Data Delivery System, 
available commercially from Norpak of Katana, Ontario* Canada acts as a con^)act protocol 
inserter 212 by receiving an RS-232 serial bit stream, buffering the bit stream, and inserting the 
bits over one or more lines of the VBI. 
S In one embodiment error checking or error correcting codes such as Hamming codes are 

inserted with the data. In one embodiment, the compact protocol inserter 212 translates the data 
into a Hamming code, and in another embodiment, the compact protocol generator 210 produces 
Hamming coded data or adds aparity bit 

The compact protocol inserter 212 is coupled to a transmitter 214 which broadcasts the 

10 compact protocol described below. In one embodiment the transmitter 214 is a conventional 
television broadcast transmitter which receives and broadcasts the signal from conventional VBI 
inserter 212 which inchides the conventional broadcast program and advertisement output signal 
from program generator 208, and the compact protocol from compact protocol generator and 
formatter 210. In this fashion, graphical interactive television information may be broadcast on 

1 5 the same frequency with a related television program. 

In another embodinnent the transmitter 214 is a conventional cable system head-end 
amplifier. In another embodiment the signal provider 208 does not output a television program, 
and the compact fffotocol is broadcast widiout a television program. 

In another embodiment the transmitter 214 is a conventional cellular telephone 

20 transmitter. In another embodiment transmitter 214 is a conventional pager transmitter. These 
embodiments allow interactive infcmnation systems to be used independently of a conventional 
broadcast such as a television brtsadcast if desired, allowing the user to access the information 
from a cellular telephone or cellular equipped personal digital assistant or even a pager. 

A graphical inter^ve television system need not use the VBI to broadcast a compact 

25 protocol for use with a television program, as a wide variety of other transports are available. 
Sonne of these transports broadcast the conduct protocol separately from the television program, 
yet retain the ability to coordinate the graphical interactive information with a television 
program. In this case, transmitter 214 does not broadcast the television program, instead 
allowing another transmitter to broadcast the prognun. This allows transmitter 214 to broadcast 

30 the compact protocol on any t; pe of frequency. In one embodiment, the transmitter 214 is a 
conventional out-of-band transmitter which transmits the compact protocol on an unused portion 
of the t;)levision frequency spectrum. In another embodiment the transmitter 214 is a 
conventional FIA transmitter. Any form of broadcast wire or cable transmitter may be used to 
broadcast the compact protocol. 

35 In one embodiment the developer of an interactive information system application may 

be a different person or entity from the broadcaster who broadcasts the application. Referring 
now to Hgures 2A and 2C, one embodiment of a provider component 266 is shown. Compact 
protocol generator and formatter 276 is similar to compact protocol generator and formatter 210. 
However, the compact protocol generator and formatter 276 is not a part of the provider 
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component 266. Instead, another party known as the developer develops the graphical 
interactive information system appUcations on the corapaa protocol generator and formatter 276 
and provides 4hem via diskette or modem or other communication device to the information 
provider. 

S The information provider loads the graphical interactive information system application 

from the developer into a graphical interactive infonnation system application server 270. The 
graphical interactive information system appUcation server 270 sends the graphical interactive 
information system application to the compact protocol inserter 272, which is simUar to compact 
protocol inserter 212. and controls the operation of tiw compact protocol inserter 212 to allow. 

10 for e3umiple.tiie information provider to control the transport, such as VBI line used to 

broadcast the graphical interactive mformation system application. In another embodiment, 
graphical interactive information system appUcation server 270 also controls the frequency of tiw 
application broadcast Transmitter 274 is similar to transmitter 214. 

TTus arrangement allows for multiple parties to contribute to the graphical interactive 
15 infonnation system. Referring now to Figure 2A, 2B, and 2D. one embodiment of the providers 
of graphical interwaive infonnation is shown. Graphical interactive infonnation system 

H«.v«l««R 281. 282. 283. 284. 285 develop applications using compact protocol 



generators and foimaners i/o lor one or more •ow, 

programs, graphical interactive infonnation system applications using provider components 266. 
20 or both, to USM8 and cable operators 292, 2M. who lebnwdcast signals to users from 

broadcasters 286, 288, 290 and may provide additional applications or broadcaster infonnation 
using provider components 206 or 266. 

.n Rvtfiwn Atmlicftrinn Disnlav and 




Control. 

25 In one embodiment, tiie reception component 234 is contained in tije user reception 

equipment simUar to conventional user reception equipmenU Refening now to Figure 3. one 
embodiment of die user reception equipment 308 is shown. Conventional television receiver 310 
such as a Sony KV32V55 is coupled to a set-top decoder 312 which is coupled via cable 322 to 
antemia 316. In one embodiment, antenna 316 is replaced by a cable 324 containing a CATV 

30 transmission signal. TTw set-top decoder 312 is similar, but not identical, to a conventional sct- 
top decoder, such as tfie Jenold DPV7217/V5B available commercially fnwn General Instnuncni 
Corporation of Hatboro. PA. THe internal contponcnts of set-top decoder 312 acconling to the 

present invention are described below. 

Refening again to Figure 2B the reception component includes a tuner 216 to receive 
35 fnan input 219 and decode a bnjadcast signal containing the compact protocol. In one 

embodiment, tuner 216 is a conventional television bK>adcast toner. In anotiicr embodiment. 
Qiner 216 is a conventional CATV niner. In another embodiment, toner 216 is a conventional 
FM toner. In anodier embodiment, tuner 216 is a conventional cellular telephone tuner. In 
anodier embodiment, wner 216 is a conventional pager toner. 

8 
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The recq)tion component also includes a data extracted' 218 coupled to the tuner 216 to 
extract the con^)act protocol from the decoded broadcast signal. In one embodiment, the data 
extractor 218 is a conventjonal VBI inband data extraction circuit, such as part number 
S AA5296 available from Philips Semiconductors of San Jose, CA. In ancrther embodiment, the 
5 data extractor 218 is a conventicmal saodenL Other conventional data extraction equipment and 
techniques may also be used In one embodiment, data extractor 218 provides a serial bitstream 
containing the extracted coiiqMCt protocol cmto bus 232. Bus 232 is coupled to microprocessor 
222 which stores via bus 232 the extracted conqiact protocol information into storage device 226 
as instructed by a pr o gram stored in storage device 224, and described below« In one 
10 embodiment, micr op rocessor 222 is a conventional 68040 mi cr o pr ocessor available 

comnteicially from Motorola, Inc., of Scfaaumburg, 111., although any suitable microprocessor 
may be used. In one embodiment storage device 226 is a conventional add r essable RAM 
menxHy air^. 

In one embodiment, the noicroprocessor 222 uses the error code information from the 

15 extracted data to dieck or correct errors, terminating the application if errors are detect^ The 
microprocessor 222 may decode the data from the error coded data by removing the enor code 
prior to storage in storage device 226. 

In <me embodintient, storage device 224 is a conventional addressable ROM. In aiK)ther 
embodiment, storage device 224 is a conventional flash memory which is readable and writable, 

20 yet retains its contents when power is no longer available. Such an embodiment allows any 
software or data which is resident in the reception component to be modified or changed by 
broadcasting it using the capabilities of the present invention. For example, a new feature of the 
reception component could be implemented via broadcast, eliminating the need for the user to 
replace a part of or all of the reception component to hnplement the new feature. 

25 As described below, the microprocessor 222 uses the program stored in storage device 

224 and the con^Mct protocol infonnation stcned us storage device 226 to generate the graphical 
user interface display infonnation, which is sent from the microprocessor 222 via bus 232 to a 
gnq^cs display generator 228. In one embodiment, the graphics display generator 228 is a 
conventional VOA graphics adqyter, such as model nund)er ET4000 available from Tseng Labs 

30 of Newtowttt PA, coupled to a conventional video genlock processor, such as model GSPSOO 
available from Integrated Circuit Systems of Valley Forge, PA The graphics display generator 

228 is coupled to bus 232 to receive the graphical user interface generated by the gr^hical 
interactive information system. 

In one embodiment, graphics display generator 228 also receives the broadcast signal 
35 corre^nding to a broadcast program via line 227 from tuner 216 to allow simultaneous display 
of the broadcast program and the graphical interactive information system application. In 
another embodiment, graphics display generator 228 receives a broadcast program signal via line 

229 from optional additional tuner 252, and line 227 is not used. This two-tuner 216, 252 
approach allows a gn^hical interactive information application to be displayed simultaneously 

9 
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with a broadcast prognm without requiring the application to be broadcast on the same 

frequency as the program. 

The display generator 228 is coupled to a display 230. In one embodiment, the display 
230 is an LCD display. In another embodiment, the display 230 is a conventional television 
receiver and the lemaining elements 235 of the reception conqwnent as later described herein are 

contained m a set>top decoder. 

In one ernbodiment, the microprocessor 222 is also coupled to a user input decoder 244 

coupled to a user input receiver 250 to allow the user to communicate with the microprocessor 
222 in oitler to operate the gr^)hical interactive information system. In one embodiment, the 
user input decoder 244 is a conventional infrared remote control decoder. Theuseriniwt 
receiver is a conventional infrared receiver 250 through which the user may use a conventional 
handheld remote control device, such as remote control 330 of Figure 3. Remote control keys 
pressed by the user translate to coded infrared signals that are received by inftared receiver 250. 
and are decoded by the user input decoder 244 and sent to the microprocessor 222 to aUow the 

user to communicate with the interactive television system. In one embodiment, the 
microprocessor 222 responds to certain remote control keys decoded when they relate to choices 
displayed by the user component 234. but not to other remote control keys, to allow the operation 
of functions unrelated to the graphical interactive information system appUcation simultaneously 
with the operation of the graphical interactive information system application using the same 
user input device. 

In another embodiment, the user input receiver 250 is a conventional personal digital 
assistant keypad device and the user input decoder 244 is a conventional keypad decoder. In 
another embodiment, the user input receiver 250 is a conventional ceUular telephone keypad 
device and the user input decoder 244 is the keypad decoder. In another embodiment, the user 
input receiver 250 is a conventional pager switching device and the user input decoder 244 is a 
conventional switching device decoder. 

R BTT*'"" Cmw pntM^t . Rxtenml Device Contiol. 

In one embodhnent. microprocessor 222 is coupled to a conventional infrared command 
encoder 256 which accepts an infrared command input and encodes a signal for a conventional 
infrared emitter 258 to allow the interactive information system to control external devices, such 

as a VCR. 




In one embodiment, certain user responses are sent to a response collector for processing. 
Referring momentarily to Figure 1. button 118 allows a user to make a selection which will send 
a $25 campaign contribution to the candidate 114. Referring again to Figure 2B data Une driver 
246 accepts data from micropiocesscr 222 and sends it to communications port 248 to allow the 
microprocessor to send user responses and other information described below to a response 
collector who may process the responses. In one embodiment, the data line driver 246 is a 
conventional modem and communications port 248 is a conventional telephone jack, which 
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allows the rccq>tioa component 234 to send user responses to a response collector having a 
receiving nmlem connected to a conventional telephone line. In another embodiment^ the data 
line driver 246 is a c<mventional DTMF tone dialer. In another embodiment, the dau line driver 
246 is a conventional controller for a system of addressable CATV set-top conveners such as the 
5 ACC-4000 addressable controller available from General Instrument Corporation of Hatboro, 
PA, used to provide conventional pay-per-view services. In this embodiment, conmiunications 
port 248 is coupled to receive the cable TV coax line 219 which is coupled to the mner 216. 
E. RecqitioB Component Timer Control. 

In one embodiment, microprocessor 222 is coupled to tuner 216 and optional tuner 252 to 

1 0 allow the microprocessor 222 to communicate with and control the tuned frequency of the tuners 
216t 252. This capability can provide such services as channel selection via the interactive 
mformation system. One such use of the service would be to allow a user to change channels 
from a program guide. The user^s selection would automatically change the tuned frequency of 
the tuners 216, 252 to the desired channel. 

IS In one embodiment, tuners 216» 252 contain a Imadcaster information table, described 

below, in a storage device 217, 253 of the omer 216, 252 identifying the broadcasto* 
corresponding to each tunable cbaimeL This allows the reception component to determine, for 
exanqple, which channel number corresponds to the Cable News Network, which may be 
necessary because different cable systems carry Cable News Network on different chaimels. 

20 Storage devices 217, 253 are coupled to the microprocessor 222 to allow the microprocessor 222 
to determine which tuner charmel number corresponds to a particular station. 

In one embodiment, the storage devices 217, 253 are ROMs, installed at the time of 
manufacture widi the charmel guide burned in. In another embodiment, storage devices 217, 253 
are flash memory to allow the charmel guide to be received and extracted from a broadcast signal 

15 like the compact protocd as described above, to allow microprocessor 222 to store the 
broadcaster information table in storage devices 217, 253. In another embodiment, the 
broadcaster information table is broadcast as a part of the compact protocol described below, the 
broadcaster information table is stored in storage device 226, and storage devices 217, 253 are 
not used. 

10 m. Compact Protocol. 

The compact protocol is used to broadcast a compact set of information and commands 
from the information provider to the user in an efficient manner, allowing the use of low 
bandwidth transports such as the VBL 

Referring now to Hgure 4, one embodiment of a method of sending and operating a 
IS graphical interactive information system using the compact protocol is shown. In one 

embodiment, an application header record is encoded and broadcast to initiate the process and 
describe the information which follows 410 412. The application header record and the 
information will define a graphical interactive informaticn system application. One or more 
desired graphical descriptions such as object or resource definition records and optional scripts 
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or commands, each described below, are encoded and broadcast in any order 416, 418. In one 
embodiment, the appUcaiion header record is received and decoded 414 prior to the encoding of 
definitions, scripts and commands 416. although other embodiments encode, broadcast, receive 
store and decode the application header record, definitions, scripts and commands in one unit. In 
5 one embodiment, no paiticuhir order of the steps described above is required as long as the 
appUcaiion header definition is broadcast before the broadcast of any definiuon. scnpt or 
command in the application. The information broadcast is received and decoded and used by the 
reception component to display the graphical information and to allow the user to interact with 
the information broadcast and perform the functions described herein 420, 422. Some or all of 
10 the information broadcast may be stored at any time 420. 

In one embodiment, a graphical interactive information system application is broadcast 
again and again, allowing a user to mne to a program at any time yet receive the entire graphical 
interactive information system application. 

Any desired updates as described below may be encoded and sent 424 and received and 
15 decoded 426. If there are additional definitions or updates of resources or objects, they may be 
sent until the appUcaiion is complete 428. 430. In one embodiment, a termimmon command 
described below is broadcast to stop the operation of the application 430. 

As described below, a new appUcation may be sent whUe an original appUcation is m 
operation or transmission, for example, to allow a new advertisement application to interrupt an 
20 original program application, which resumes operation upon termination of the advertisement 
application. In one embodiment, the new application is also broadcast and operated usmg the 
method described above and shown in Figure 4. A suspend application command is sent by the 
new or original application in order to suspend the operation of the existing application, and a 
resume appUcation command may be sent by either application to terminate the new appUcauon 
25 andresumetf«operationoflheoriginalappUcation.Inanotherembodiment.thenew 

application must send a termination command in order to terminate itself, as a resume 
application coimnand would only suspend the new application and resume the original 

"^''""fi'Lise descriptions of standard graphical objects are transmitted in place of many of the 
30 bimiaps or other high-bandwidth display components which would otherwise be required. 

several advantages are realized. First, a low-bandwidth transport such as the VBl is adequate to 
allow the display of complex graphics. Second, tiie system is dcvice-independent TTie 
information provider simply describes the effect desired and each reception component 
reproduces it as best it can. An effea or image for which display is not allowed or not possible 
35 on the reception componem can be ignored by that reception component, but displayed on other 
rsception components. 

d ol^^^^nTri ^Pl^on begins with an application header record to identify 
the information as the start of an interactive application. In one embodiment, if application 
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infcHTnadon is received without an plication header, the application may be stored, but may not 
run. 

Referring now to Figure 5* one embodiment of an application header record 508 is 
shown. Byte 510 idratifies the dau as an qyplication header record 508, by having a value equal 
S to 1. Byte 512 describes the plication type. Byte 512 having a vahie equal to 0 signifies a 
program qyplication such as that described above for use with the politician's speech. Byte 512 
equal to 1 signifies an advertisement ^yplication. 

Byte 512 may have a value equal to 2, signifying a virtual interactive channel. Byte 512 
may have other values, indicating other forms of applications. 
10 Referring now to Figures 2A, 2B and 5, bytes 514, 515 contain the version and revision 

number, respectively, of the protocol used to communicate between the provider component 206 
and the reception component 234 as described below. The receipt of version and revision 
numbers by a reception component 234 allows the reception component 234 to respond to 
protocols which are generated by different versions or revisions of the protocol generator 210. In 
IS one embodiment, the reception component 234 disregards a protocol which specifies a version 
number of which the recepdon component 234 is unaware or incompatible. 

Referring again to Hgure 5, long word 516 is an application identifier, a unique identifier 
which identifies the applicadon. This information may be sent to a response collector to identify 
the information provider and application which generated the response. In one embodiment, a 
20 long word is four bytes in length, although odser lengths may also be used. 

Bytes 518t 522, and word 520 assist the micr opr ocessor in its memory management 
function described below by identifying many of the memory requirements in advance. In one 
embodiment, a word is two bytes in length, although other lengths may also be used. Byte 518 
contains the number of forms in the application, byte 522 identifies the total nu.mber of script 
25 resources, and word 520 identifies die total number of text, bitmap and picture resources defined 
by the application. These terms and their operadon are described below. 

In one embodiment, bytes of all records are broadcast in the order shown in the Figures 5, 
6, 7B, 8, 9, 10, lU 12, 13, 14A, 14B, 14Q 14D, 14E, 15, 16, 17A, 17B and 22. 

B. Graphical Object Definitions. 

30 The compact protocol allows the broadcast of gn^hical interactive information by the use 

of a set of graphical object definiticxis. Graphical object definitions describe characteristics of 
graphical objects, such as size of the object, color of the object, location on the display, and other 
characteristics of the graphical object Gn4)hical objects include the form object, buttons on the 
form, bitmaps, pictures, lists, as well as non-graphical objects such as timers. In one 

35 embodiment, a text object contains descriptive infmnation such as font and color about a text 
string, as well as the location of the text string, but does not contain the text string itself. Text 
strings are resources, and are separate from a text object which describes them. 
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1i Fnnii TMinitwm 

Each application may contain one or more fonns. A foim is a coUccrioo of objects which 
are defined as a smgle unit by the infonnation provider usmg a form definition record. Objects 
in a form which are capable of being displayed are displayed together. 

Referring now to Figure 6. one embodfanent of a form definition record 608 is shown. 
Byte 610 has a value of 2 to identify die record as die start of a form definition. Word 611is the 
size, in bytes, of die form definition record. Byte 612 is an identifier assigned by the 



30 




defined 



menu a 



second form having *e same form number as one aheady defined in an application is ignored. 
10 Block 614 contains one or more object definitions for die fomi as described below. 

Referring now to Figures 2B and 6. in one embodiment, after microprocessor 222 

receives a form definition record 608. die microprocessor 222 under control of a program stored 
in storage device 224 aflocates an area of die storage device 226 for die forni. die objects on die 

form, resources required by die form and appUcation control information to allow die user to 
15 interact widi die form. Microprocessor 222 generates and stores several tables in stora^ 

226 as described below. 

nhject D efinitions. 

Several standard objects may be defined using compact object definitions, which allow 
die user to specify die look of graphical objects by transmitting an object identifier as die first 
20 byte of die object, and only a few parameters. 



One type of object is a form object A form object defines a rectangular region of die 
screen and die appearance of die region. The infomiation provider defines fomi objecu using a 
form object definition record. ^ -ac 

25 Referring now to Figure 7A. one embodiment of a form object 700 havmg a border 706 

and an interior 702 is shown disptoyed on a ««en 703 of a conventional television set 704. 

•me form object may be transparent, in which case die odier objects in die form appear to 

float over die dispUy. If die display is a television screen, and die appUcation is not a graphical 
interactive virtual chamiel, a transparent form object can cause die odier objects in die form to 

appear to float over die bio^lcast picture. Od«rwise. die form object covers all or a part of die 
broadcast picmre and die objects may cover all, a part, or none of die form. 

Referring now to Figures 7A and 7B. one embodiment of a form obje« defmiuon record 
708 is shown. Byte 710 identifies die object as a form by having a value of 000001 m die least 
six bits Bytes 712, 714, 716, 718 contain die position of die left side, top. right side 




35 andbottomofdieform700.respecavely,reiativetomeccn«^.v*w.-*-w.-^..--~ » 
coane coordinate system. A coarse coordinate system is a representation of a unit of widdi and 
height In one embodiment die unit of widdi «id he::^t is selected to allow represenumon of die 
entire widdi or height of die display in a single byte of 256 unique numbers. In <«-^-;^2-^ 
die display is a Nordi American television signal television scr.«i according to NTSC standards 
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haviog a width of 160 color clock widths, each color clock width being the width covered by the 
electron beam in 280 nanoseconds, and a height of 400 interiaced scan lines. In one 
embodiment, coarse coordinate units equal one color clock in width and two scan lines in height. 
In one embodiment, the center 701 of the screen 703 is represented as coarse coordinates 128, 
128. 

Byte 719 contains a descrif^on code for the style of the border 706 of form 700. In one 
embodiment, valid desoiption codes are 0 for no border, 1 for a thin line border, 2 for a thick 
Ime border, 3 for a gothic style border, and 4 for a border having a "wavy" appearance, though 
other embodiments could use other codes or styles. Byte 720 contains a color code for the color 
of the bolder 706. Byte 721 contains a color code for the colcn* of the interior 702 of the form 
700. 

Byte 722 and wcml 724 are used to locate the script, described below, for the form. Byte 
722 is an index into a script handle table for the location of die first byte of a script resource 
containing the script to execute. A script handle table is a table of pointers to the script resources 
for the application. A script resource is a block of memory which may contain numerous 
scripts. In one embodiment, a script resource may not exceed 64K bytes in size. Word724 
contains the offset from the first memory location of the script resource to the initialization 
script. 

If die most significant bit of byte 710 is set, block 730 contains optional hint information 
regarding the appearance of the form, such as textured appearance or transition effects such as 
fade in and fade out Winte fnr ftmhndimgnt are listed in Appendix A. If the capabilities of 
the uso^s interacdve system cannot accoimiKxlate the appearance or effects mdicated by the 
hints, the interacdve system may ignore die information or display it as closely as possible. If the 
most significant bit of byte 710 is cleared, block 730 contains no bytes and is not used. 

b, Button Qbi«tt> 

Another object is the button object Referring now to Figure 1, buttons 118, 124 are 
selected by the user in order to interact with die gr^)hical interactive information system. A 
button is defmed by the information provider using a button objea definition record. 

Referring now to Figure 8, one embodin»nt of a button object definition record 808 is 
shown. Byte 810 has a value of 2 to identify the definition as a button object Bytes 811, 812, 
813, 814 identify the positions of the left edge, top edge, right edge, and bottom edge of the 
buttcm as a distance from the upper left hand comer of the form in coarse coordinate units. 

Word 816 contauis a resource number corresponding to a text, bitmap or picture resource 
to use for the button. Numbers on the button are inserted automatically on this image based 
upon the location of the button on die form. Optional byte 817 contains text color information, 
and optional wmd 818 contains bits corresponding to die font, size and style of the text if the 
resource is a text resource, indicated by setting die second most significant bit in Byte 817. 
Resources are described below. In one embodiment die text size measurement is in l/500di of a 
display screen height 
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Byte 820 contains an index into Ae script handle table to the pointer for the script 
resource containing the script to execute when the user selects the button. Word 822 contains an 
offset from the start of the script resource to the script to be executed when the user selects the 

button. 

5 The most significant bit of byte 810 is set if hint information exists in block 828. A hint 

is a description of how an object can appear on certain systems capable of displaying such an 
appearance. Where the reception component is not capable of such a display, the hint may be 
ignored, or the recepdoo component may provide an appearance matching the desired 
appearance as closely as possible. Numbers are assigned to buttons and displayed by the 

10 reception component, but these assignments may be overridden using hints. Other hints for one 
embodiment are listed in AnsmlULA- Optional block 828 contains one or more bytes of the him 
data if the most significant bit of byte 810 is set, and block 828 contains no bytes otherwise. 

Text object descriptions are provided by the information provider to describe the location 
15 and appearance of text, but do not contain any of the actual text itself. The text itself is a 

resource, described below. 

Referring now to Figure 9. one embodiment of a text object definition record 908 is 
shown. Byte 910 contains an object type identifier having a value of 3 to indicate the object is a 
text object Bytes 912. 914, 916, 918 describe the left edge, top edge, right edge and bottom 

20 edge, respectively, in coarse cooidinate units from the upper left comer of the form object, of a 
box tato which th^ text resource may be placed by the reception component Byte 920 contains a 
code for the color of the text Byte 922 contains text alignment information. Word 924 contains 
the resource handle of the text string which the reception componem is to display in the box. 
Word 926 defines the font, size and style to use to display the resource. The fom makes 

25 up the first four bits, the size makes up the next six bits and the style nttkes up tiie remaining six 

bits of word 926. u j v 

Block 932 contains optional hint flags, size and data similar to the hints descnbed above 

and shown in Figure 8. 

ffitwiap Obiects . 

30 A bitmap object is used to display a bitmap resource, described below, on the form. An 

information provider defines a bitmap object using a bitmap object definition record. 

Referring now to Figure 10. one embodiment of a bitmap object definition recoiti 1008 >s 
shown TTie least significant six bits of byte 1010 contain an object type identifier having a value 
of 4 to indicate the object is a bimiap object Bytes 1012, 1014, 1016, 1018 define the left edge, 
35 top edge, right edge and bottom edge, respectively, in coarse coordinate units from the upper left 
comer of the form object of a box into which tiie bitmap may be placed. 

Word 1022 contains a handle to the resource containing tiie bimiap. Block 1032 provides 
hints as described above and shown in Figure 8. 
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e. ListObfft^s 

A list objea provides the user with a list of options and allows for a selection of one or 
more options. An information provider defines a list object using a list object definition rcconL 

Referring now to Figure 11, one embodiment of a list object definition record 1108 is 
S shown. The least significant six bits of byte 1110 contain an object type identifier having a value 
of 5 to indicate the dgect is a list object Bytes 1111* 1112, 1113, 1114 define the left edge, top 
edge, right edge and bottom edge, respectively, in coarse coordinate units from the upper left 
comer of the fonn object, of a box into which the list may be displayed. 

If the second most significant bit of byte 1110 is set, then word 1116 holds font, size and 
10 style infonnation similar to word 926 of Figure 9 and Byte 1117 holds the color code of the list, 
otherwise word 1116 and byte 1117 are unused. Byte 1118 holds the number of entries in the 
list, and byte 1120 allows a default selection to be specified using the order of the entries in 
block 1122 beginning with entry 0. In one embodiment, the default selection is initially 
highlighted to indicate which entry will be selected by the user if the user selects a button marked 
IS "yes** as instructed by the scripting commands described below. Block 1122 contains one or 
more words containing the resource handle, described below, of the each entry in the list 

Optional block 1128 provide opticmal hint data as described above and shown in Figure 
8. In one embodiment, the reception conqmnent displays the resources along with a number it 
assigns to each resource to acconunodate selection by the user, utUess overridden by hints. In 
20 another embodiment, user responses, such as specific remote control keys, are assigned to move 
a cursor up or down the items in the list 

f. Tin>er Objects. 

Timer objects allow the graphical interactive information system application to use timed 
events, such as a timed response to a question in a game. An infonnation provider defines the 

25 timer object using a timer object definition record. 

Referring now to Figure 12, one embodiment of a dmer object definition record 1208 is 
shown. The least significant six bits of byte 1210 contain an object type identifier having a value 
of 6 to indicate the object is a timer object The second most significant bit of byte 1210 is a flag 
indicating if the timer opcntes one time, or restarts again after each period has elapsed. Word 

30 1212 contains a value equal to the period of the timer in l/60ths of a second. Byte 1214 contains 
the script handle of the script resource containing the script to execute at the end of the period 
indicated as described above. Word 1216 contains an offset from the start of the script resource 
specified as described above to the script to execute when the period has elapsed from the time 
the object is received or the last period ended. 

35 B, Picture Objects- 

A picture object allows an infortnation provider to define a picture using a picture 
resource, which is a list of several bitm^, text resources and drawing primitive functions, 
which can allow the picture resource definidon to be more compact than an equivalent single 
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bitnum resource. An information provider defines a picnirc object using a picture object 
(iefinition record. 

Referring now to Figure 13. one embodiment of a picture object definition record 1308 is 
shown. Byte 1310 contains an object type identifier having a value of 7 to indicate the object is a 
5 picwre object Bytes 1312, 1314, 1316, 1318 define the left edge, top edge, right edge and 
bottom edge, respectively, in coarse coordinate units from the upper left comer of the form 
object, of a box into which the picture resource may be placed. 

Word 1322 contains the handle of a pirture resource, described below, to display in the 
box. Block 1328 provide hints as described above and shown in Figure 8. 

Unlike object definitioos which define the appearance of an object, resources represent 
dau which can be dispUyed. The compact protocol also allows the information provider to 
define certain rcsourees. such a bitmaps, to provide the pictures or icons 120, 122 shown in 
Figure 1. Text is also provided through the use of resources. Son* resources are predefined, 
15 and others may be defined by Ae information provider. An information provider defines 

resources using resources definition records. 

Referring now to Hgure 14A. one embodiment of a resource definition record 1408 is 
shown. Byte 1410 identifies the record as a resource definitioir record by having a value equal to 
2. Word 1411 contains a value equal to the number of bytes in the resource definition record. 
20 Word 1412 is die resource handle of the resource. 

In one embodiment, four types of resources may be defined in block 1414. a text 
resource, a bitmap resource, a picture resource and a bitmap resource list. Tlie stored program m 

the storage device of the reception component wiU interpret the resource and format it according 
to the capabilities of the reception component so tiiat it may be rendered as closely as possible to 
25 the definition. If necessary, die stored program may discard a resource definition daui tiiat it 
camiot use. for example, because the resource has a higher resolution tiian die recepuon 
component is capable of rendering as described below. 
IJ^SLBfiSfilUBS-. 

A text resource contains text data. Referring now to Figure 14B. one embodiment of a 
30 text resource 1428 is shown. Byte 1430 having a value equal to 1 identifies die resource as type 
text, and block 1432 contains a nuU terminated text string, such as ASCnZ. 

? Bitniap Resources. 

A bitmap resource is used to hold bitinaps. Bitmaps are described in Wiewer. ECAMJA 
Progranuner's R^erence Guide (2nd. ed.. McGraw HiU 1990). Referring now to Figure 14C. 
35 one embodiment of a bitmap resource 1438 is shown. Byte 1440 having a value equal to 2 

identifies die resource as type bimup. In one embodinxnt, die resolution of die bimuip « higher 
dian die coarse coordinate system, allowing die utilization of d« fiill display resolution of die 
reception component Bytes 1441, 1442, 1443, 1444 define four colors for use as descnbed 
below. Word 1446 defines die widdi in pixels of die bitmap and word 1448 defines d« height of 
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the bitmap in pixels. Block 1450 contains one or more bytes of the bitmap data, each byte in 
block 1450 containing four pairs of bits, each pair representing one of the four colors defined 
above, of a pixel Each pixel is drawn to the right of the pixel before until the pixel width 1446 
is reached, at which point the next pixel is drawn at the left boundary of the next row and the 
S process repeats until all the pixels are drawn. 

Any fmn of bitms^ or similar fonnat may be used. For example, bitmaps using a byte 
per pixel, when each byte represents the color of a pixel, may be used. 

In one embodiment, the bitmq> data is compressed using such compression techniques as 
conventional run-length encoding. 

10 3. Picture Resources, 

Picture resources are used to bold zero or more grq)hical elements such as text strings, 
bitau^, and primitive drawing functions, as well as relative position information. Referring 
now to Figure 14D, one embodiment of a picture resource 1458 is shown. Byte 1460 having a 

* 

value equal to 32 identifies the resource as type picture. Word 1462 contains the number of 

15 bytes in the picture resource definition record. Block 1464 contains zero or more picture 
resource elements described below. 

Referring now to Figure 14E, one embodiment of a picture resource element is shown. 
The least significant six bits in byte 1470 indicate the type of the element Element types include 
text or bitmap resources, as well as drawing functions such as ellipse, circle, horizontal line or 

20 vMical Ime. The type codes are listed for one embodiment are: text & 24, bitmap s 32, point 
drawing function s 1 , horizontal line drawing function s 2, vertical line drawing function = 3, 
rectangle drawing function « 4, filled rectangle drawing function » S, diagonal line drawing 
function s 6, ellipse drawing function s 7, circle drawing function s 8, and spline drawing 
function = 9. The most significant bit of byte 1470 indicates the last element in the picture 

25 resource, allowing multiple elements to be a part of a picture resource. Bytes 1472, 1474 contain 
the X and y coarse coordiiuue relative to the center of the screen of the upper left comer of the 
element, and bytes 1476, 1478 contain the x and y coarse coordmates relative to the center of the 
screen of the lower right comer of the element, except for the horizontal line drawing function, 
which does nor contain byte 1478, the vertical line drawing function, which does not contain byte 

30 1476, aiul the point drawing function and bitmaps which do not contain bytes 1476 or 1478 
because in each case, the omitted byte or bytes are utmecessary. Byte 1480 contains the color 
code for the element, unless the element type is bitmap. Word 1482 contains a resource handle if 
the type is text or bitnuip, otherwise, word 1482 is unused. Block 1484 contains additional 
information if the type is text, similar to word 926 of Figure 9. 

Resource lists contain one or more bitmap resources. Referring now to Figure 14F, one 
embodiment of a resource list 1488 is shown. Byte 1490 contains a unique value to identify the 
resource as type resource list Block 1492 contains one or more resource list elements. 
Referring now to Figure 14G, one embodiment of a resource list element 1498 is shown. Word 
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14J7 contains an offset to the byte foUowing the resource list element, or zero if resource list 
element 1498 is the last element in the list Block 1499 contains a bitmap resource described 
^ve and shewn in Hgure 14C. 

5 Referring now to Figure 2B. in one embodiment, microprocessor 222 performs several 

„»mory management functions. Microprocessor 222 maintains in storage device 226 a pointer 
to each form in an application using a form handle table. The fomi handle table contains a 
pointer to the first byte of each form object in the application. The objects in each form are 
stored as a linked list, widi the form object pointing to the ftfst object in the linked list An 

10 object is located by using the form handle table to locate the form, and then traversing the h^^^^ 

list until the desired object is located. In one embodiment, objects may be referenced by type and 
position in the Ust For example, button 3 is the thhd button found whUe traversing the list In 
another embodiment. aU objects are sequentially numbered in the list, and objects are referred to 

by this object number. 

■nie location of each resource is stored using a resource handle table in which each entry 
in the table contains a pointer to the resource, m resource is locked by using a resource handle 
index to locate the pointer in the resource handle table, and using the pointer to locate the 
resmuce. 

Because several applications may be resident in the storage device 226 at one ume. more 
20 than one set of the tables and lists described above may be maintained by microprocessor 222. 

allowing a program application to stay resident while an advertisement application is operaung. 
so that the program application need not be reloaded after the end of the advertisement when the 
program resumes. Tlie program application or advertisemem application may be suspended or 
temunated by an advertisement application. In one embodiment more than one advertisemem 
25 application may be resident in storage device 226 to allow a user to send a response to one 

advertisement application after the advertisement terminates, yet still receive the application for 
the following advertisement In one embodiment only the form or forms of the apphcauon 
related to the response wUl remain in storage device 226 after microprocessor 222 receives a 

second advextisement application. 
30 In one embodiment a program application is allocated a larger percentage of memory 

than an advertisement application due to the longer running time of the program application. In 
one embodiment a program application may occupy 75% of the available memory as descnbed 
below, leaving 25% for one or more advertisemem appUcations. A virtual interacuve channel 

appUcation may occupy 100% of the available application memory. 
35 In one embodiment ii«mo,y is allocated by limiting the number of available hand^^ 

the applic-ion-s handle table based upon the type of application as described above. Although 
diis embodiment does not stiicUy enforce the acmal memory usage of the applicauon. ,t provides 
a reasonable level of protection without a significant increase in complexity of memoiy 
management In this embodiment the number of handles to be allocated may be based upon 
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experience of the average size of the memory required as a result of each entxy in the handle 
table. In one embodiment, the average size per entry is SO bytes. 

In another embodiment, memory itself is allocated by tracking the amount of memory a 
graphical interactive information system application uses as the memory is reserved, and 
S terminating the application if the application's memory allocation is exceeded. 

E, Updates . 

The compact protocol also allows the information provider to update information used by 
previous defmitioas so that the appearance of a form can be modified quickly without resending 
a large amount of data required to reseiul the entire application or form. An information provider 

10 sends an update record to r^lace a form, one or more objects on a form, or one or more resource 
definitions in an application. 

Referring now to Figure 15, one embodiment of an update record 1508 is shown. Byte 
1510 having unique values to identify the record as an update record to update a form, one or 
mm objects on a form, or (me or more resources* respectively. Word 1512 identifies the size in 

IS bytes of die reconL Block 1514 is the handle of a form to replace, the form containing the 
objects to replace or the resource to replace. Block 1516 contains a form object definition 
record, one or more buttmi, text, bitnup, picture, timer or list object definittoo records, or text or 
bitmap resource definition records described above to replace the object or resource indicated in 
byte 1514. 

20 In one enibodiment, entire forms are updated by storing the objects of the form and 

adjusting the handle to the old form to point to the new form. One or more objects in a form 
nuiy be updated by storing the new object and then inserting the new object in the linked list 
Ruddng up the form in place of the old object A resource is updated by storing the new resource 
and adjusting the resource handle table to point to the new resource. 

25 F InrtnietioM. 

The coiiqMict protocol also allows the information provider to send instructions to the 
rec^tion component to control the operation of the interactive infmnation system. 

A form may be displayed using a two byte comnuuxL The first byte has a value equal to 
S to indicate the commarul is a form display conunand, and the second byte contains the form 
30 number. The form dtq)lay conunand allows the infmnation provider to display a form without 
any input from the user. 

A program application may be suspetMled or resumed by an advertisement application or 
virtual chaimel using the single byte conmiands suspend and resume, having a value of 6 and 7, 
respectively. An qypiication may be permanently terminated by sending a single byte command 
35 having a value equal to 8. 

G Intcractivg Icon Dcfinition- 

In one embodiment, an interactive icon is shown on the display to indicate an interactive 
application has been received by the reception component The user can then press one or more 



21 



WO 96/34494 

keys on the remote control to display the first foim of the application. The information provider 
may control the icon displayed by sending an interactive icon definition record. 

Referring now to Rgure 16. one embodiment of an interactive icon definition record 
1608 is shown. Byte 1610 contains a vahie of 9 to identify the record is an interactive icon 
5 definition record. Bytes 1612, 1614, 1616, 1618 define die distance in coarse coordinate units 
from toe center of the screen of die left edge, top edge, right edge and bottom edge, respectively, 
of a box in which the interactive icon wUl be displayed. The upper left edge of die icon is placed 
at die upper left edge of the box defined. Word 1620 is die resource handle of die resource to be 
displayed as the icon. 

10 H Scripts. 

Scripts are a sequence of one or nwre scripting commands provided by an mformauon 
provider. A script may be executed when received, or may be executed in response to an action. 

Id one embodiment, die compact protocol aUows an information provider to send a script 
which is executed upon receipt and d«n discarded. An information provider defines die script to 
15 execute using a script execute record. Referring now to Rgure 17A. one embodiment of a script 
execute record 1708 is shown. Byte 1710 having a unique value to identify die record as a scnpt 
execute record. Word 1712 contains die number of bytes fai die script execute record. Block 
1714 contains die script resource, containing one or more codes as described in AsBodULfi. 

The compact protocol also allows die information provider to provide scripts defining die 
20 operation of die system in response to user selections or oUier events. Four objects may have 

scripts associated widi diem: forms, lists, buttons, and timers. The form object script is executed 
when die form is displayed. A list object script is executed when die user indicates a selection. 
A button object script is executed when die user selects die button. A timer object script is 

executed at the end of the timer period. 

25 A script can display or hide a form or an object on die form, modify an object's 

characteristics, such as color or size, or modify which resource an object wiU use. A script can 
also declare variables unique to die script and change die values of diose variables. A scr^it can 
use standard logic fimctions, such as -or", "and", "if-dien". etc. In one embodiment, die script 
can perform all die madi and logic functions of a conventional basic interpreter. 

30 Referring now to Figure 17B. one embodiment of a script resource 1718 is shown. Byte 

1720 having a unique value to identify die resource as a script resource. Word 1722 contains the 
number of bytes in die script resource. Byte 17^3 contains die handle used as an identifier of die 
script resource. Block 1724 contains die script resource, containing one or more codes as 

described in AlZ!SIUiUL£- , . . ..... 

35 Responses are scripted as well, including d« formatting of a response byte or byte 

containing product information, quantity, or die like. In one embodiment, a script may contain 
one or more of four unique scripting commands which generate responses. 

An -order- scripting command allows a user to use die interactive information system to 
order a product or service from a vendor. An order scripting command contains a one-byte code 
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representing the command, one word of cost infonnation and a one byte variable indicator to 
allow the infonnatira frovider to indicate a variable to return as described below. The cost 
infoimation may be used by the recq>tion component 234 of Figure 2B to check the price of the 
Older to verify that it does not exceed a user's predefined limit to assist the user for budgeting 
S purposes. The variable indicator is acode to nidicate a variable to reoim as described below. 
The variable may be built by the infonnation provider using the scripting language, and in one 
embodiment, the variable is four bytes in length. 

A ''request'* scripting command allows a user to request infonnation for no charge. A 
request scripting command is similar to the order scripting command, but, no cost information 

10 byte is passed to the reception component for verification. 

Two scripting commands are used which generate anonymous responses described 
below. A "respond" connmand has a format similar to the request scripting conunand, to allow 
the generation of a four byte response to be defined by the mfonnaticH) provider using the 
scripting language. A "vote" scripting command is a single byte conmund which generates a 

15 response having only one byte which contain predefined codes for "yes", "no", "abstain" and 
"dont know," to allow for simple, compact response generaticm. 

Referring now to Hgure 2A, scripts are defined by the infonnation provider using the 
compact protocol generator 210. In one embodiment, the compact protocol generator 210 has a 
user interface allowing characteristics of objects to be defined or modified or other actions to be 

20 taken using an object oriented fonnat, such as "forml ^ow" to display the first form. Other 
conmiands such as assignment of variables and logic functions are defined using a set of 
conmuuids similar to the BASIC p rogr amm ing language. 

Tht protocol generator convens the B ASIC*like conunands to one or more numeric 
codes, and includes the codes in the application broadcast One embodiment uses the codes 

25 described in A ppendix B. 

In one embodiment, scripts are stored in a script resource, which is an area of memory up 
to 64K bytes long which stores one or nuxt scripts. A script handle table keeps track of all script 
resources by storing the memcny location of the first byte of each script resotuce. The precise 
location of the start of each scrij^ is provided to the system as an index into the script handle 

30 table, and an offset from the location pointed to by the script handle table entry corresponding to 
the index. 

Scripts are executed using a conunand inte ipiet er which performs the functions indicated 
until it reaches an end of script identifier. In one embodiment, the script instructions are 
interimted directiy from the codes which make up the script resource, and in another 
35 embodiment, script instructions are first converted into C-m- code prior to interpreting them. 

Referring now to Figures 2A, 2B» 2C and 18C, in one embodiment, an information 
provider such as a cable television operator uses the provider component 266 to create, insert and 
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broadcast broadcaster information as a graphical interactive information system application for 
reception and decoding by a reception component 234. 

In one^embodiment, die information provider provides broadcaster information to allow a 
reception component 234 to build a broadcaster information table. A broadcaster information 
5 table organizes some or all broadcaster information to allow the reception component 234 to 
locate the wned frequency or other identifier of a broadcaster or an application. 

Broadcaster information may reach the mformaiion provider in a variety of ways. 
Broadcasters or other farformation providers may send broadcaster information relating to their 
b„«lcasts to die information provider. For example, the transport a broadcaster uses to 

10 broadcast graphical interactive information system applications, such as VBI Une 14. and the 
broadcaster's network identifier, such as CNN. may be provided by the broadcaster to die 

information provider who will provide broadcaster information. TTie broadcaster can also 
identify whether it provides programs, interactivity or both, and any interactive information 
system protocols it uses. Thus, a broadcaster may be an mforroation provider for interactive 
15 information system appUcations it broadcasts, and provide content to another information 

provider, the cable operator, who broadcasts the broadcaster information via its own provider 
component 206. 

TTie information provider who wiU broadcast die broadcaster information can assemble 
mformation received by others, provide its own broadcaster mformation or botii. For example. 
20 the cable operator can provide the chamiel guide containing a frequency identifier such as the 

frequency or chamiel number and call letters for each of die broadcasters on die cable system m 
addition to information it receives from broadcasters or odier parties. 

In one embodiment, an mformation provider broadcasts a broadcaster informauon table 
by broadcasting broadcaster information such as broadcast channels available to die user, die 
25 broadcast frequency corresponding to die chamiel. call letters corresponding to a broadcaster on 

die chamiel. network identifiers for die broadcasters, or mteractive information protocol or 
location information for a broadcast or an application 1810. whedier a broadcaster broadcasts 
programs, graphical interactive information system appUcations or bodi 1811. a broadcast 
program timed frequem^ location identifier 1812. and interactive information system appUcatio, 
30 timed frequency identifiers 1814 for die broadcaster or for particular applications broadcast by 

the broadcaster or Others. 

Referring now to Figures 2B and 18B. in one embodiment, die recepuon component 
receives die broadcaster identifiers 1820. whedier a broadcaster broadcasts programs, graphical 
interactive information system applications or bodi 1821, broadcast program mned frequency 
35 location identifiers 1822, and interactive information system application mned frequency 
identifiers 1824 and stores dus information in storage device 226. 

Referring now to Figures 2B and 18C. a desired frequency is located given any of die 
entries in die broadc«aer information udile by locating a desired entry 1830. identifying the 
mned frequency of die desired broadcaster or interactive information system application 1832 
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and tuning the desired frequency 1834. for exanq)Ie, if channel 4 contains KRON, the NBC 
afniiate. broadcasting graphical interactive infonnation system ^plications on line 14 of the VBI 
on channel 9, this infonnation is stored in the reception conqxnient 234 as described above. An 
interactive explication corresponding to channel 7 may instruct the reception con^nent 234 to 
S switch the tuned frequency of the program channel to the NBC affiliate using a conunand which 
only identifies NBC as the target channel. The interactive information system reception 
component 234 may then identify the prq)er channel corresponding to the NBC afiRliate as 
channel 4 by locating the desired broadcaster in the broadcaster information table, identifying the 
tuned frequency or channel of the desired broadcaster from the entry containing the broadcaster 
10 information 1832 and switch the tuned frequency of a tuner m reception component to the 

channel or frequency of the desired broadcaster or application 1834. When tuner 216 is changed 
to channel 4, eidier by the user or an interactive infmnation system application* reception 
compcment 234 under cmtrol of microprocessor 222 using the broadcaster infonnation table can 
switch tuner 252 to channel 9 and decode ttie line 14 of the VBI to obtain interactive infonnation 
IS system plications corresponding to the broadcast program on diannel 4. In one embodiment, 
the previous channel or application mfonnation is stored hi storage device 226 to allow the 
interactive information system to return the user to the original channel 7, for example if the user 
exits the new application or the interactive information system ai^Ucation on Ime 14 of the VBI 
of channel 9 is not received. 
20 Refening now to Figure 2B, as described above, in one embodiment, information related 

to interactive information system qyplications may also be broadcast* received and stored as a 
part of the broadcastn* information table. If graphical interactive information system application 
number S407138 will be broadcast by KRON, this mformation may also be a part of the 
broadcaster infornuuion table, allowing the interactive information system to locate this 
application upon conunand, for example, from another interactive information system 
application, without changing the program channel, for example by changing the tuned frequency 
of tuner 217 without changing the tuned frequency of tuner 252. 

In one embodiment, the developer uses the compact protocol generator and fonnatter 276 
to create interactive information system applications which refer to other ^jplications by using 
application identiHers, and the gr^ihical interactive information system application server 270 
allows Ae broadcaster to further modify the qjplication by adding available broadcaster 
information regarding the other applications to allow the reception component to locate the other 
qyplications. 

V. Imflfe ngncrarion. 

An applicatim may display the first fonn when the reception component receives the 
qyplication header record, the first fonn definition, including objects for that fonn. and resources 
related to the objects on the form. Additional fonns may be broadcast while the first form is 
being displayed. In one embodiment, if the user response causes the application to display a 
form for which the form definition or one of the required object or resource definitions has not 
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been received by the reception component, the appUcaaon wUl wait for 10 seconds for the 
receipt of the missing information, and if not received, abort the application and display an error 
message. 

Referring now to Figure 2B, display generator 228 contains an addressable video RAM. 
5 When a VGA color code is written into the video RAM of the display generator 228. a pixel 
appears on the display 230 corresponding to the address of the code written. TUus by sending 

various bitmaps, the form is displayed. The use of bimaps and video display adaptcn is 
described in Kliewer. EGA/VGA Prograntmer s Reference Guide (2nd. ed.. McGraw HUl 1990). 
In one embodiment, aU color codes are broadcast as VGA color codes. VGA color codes 
10 are described in Kliewer, EGAA^GA Programmers Reference Guide (2nd. ed.. McGraw Hill 
1 990). In another embodiment, a different set of color codes are used. In one embodiment, the 
color code is converted at display time to a color suitable for the reception component by 
mapping it to another color. Fbr example, some of the VGA color codes are too bright for use on 
certain displays, such as color televisions, and thus, a 256 entry lookup table is used to convert 
15 the VGA code mto the acceptable code. In one embodiment, the result of the lookup reduces the 
saiuraUon of the RGB values by 25%. In anodier embodiment, codes indicating saniration of the 
RGB values in the top 25% are held to 75% of the maximum. The 25% value was selected to 
accommodate the color restrictions imposed by the NTSC video signal standards, and 
conventional color television circuitry. The lookup table approach can map to any number of 
20 colors. In one embodhnent, 100 colors are used, another embodiment uses sixteen colors, and 
another embodiment uses only two colors. 

The reception component stores bitmap resources defined using bitmap resource 
definiuons described above in storage device 226. In one embodiment, all text characters in 
various fonts, styles and type sizes are stored as predefined bimiaps in storage device 224 to 
25 allow for rapid display of these characters. In another embodiment, these text characters are 
stored as outline fonts, and bitmaps are generated from the outUne fonts. Other predefined 
resources are also stored to allow commonly-used objects such as bitmaps of credit cards. 

Predefined resources are lifted in Appendix Q- 

Referring now to Figure 19. a method of generating the images from the form object and 

30 odier object definitions is shown. When a display form command is received, cither via the 

broadcast or via a script, the video RAM is erased 1910 and the objects and resources are drawn. 

In one embodiment, the form object is drawn first 1912. followed by the objects and resources 
appearing on the form 1914. 1916 until all objects and resources are drawn 1920. This allows 
the objects and resources to appear overlaid onto the form. CDbjects and resources are located 
35 using the handle tables described above. 

Referring now to Figure 20. one embodiment of a method of drawing an object is shown. 
An object is drawn by reading the corresponding object definition 2010. generating a bimiap 
corresponding to the object definition read 2012 and sending it to the graphics display generator 
3014. In one embodiment, the entire bimu^ is generated 2012 prior to sending 2014. In another 
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embodiment, portions of the bitmap art generated 2012 and sent 2014 until the entire bitmap is 
complete 2016, 2018. Generating the bitmap is accomplished by rendering the color of each 
pixel within the boundary of the object as specified by the object definition. 

Referring now to Rgure 21, one embodiment of a method of drawing a resource is 
5 showiL Each bit in the bitmap of a resource is read 2108 and translated 2110 into the format of 
the grq>hics display generator if required For example, each bit in a four-color bitmap resource 
may be translated into a modified VGA color code as described above. The translated bit is sent 
2112 to the grq)hics di^lay generator using the position information in the resource definition 
for display by die display device. In one embodiment, all of the bits are assembled 2110 into a 
10 bitmap prior to sending 2112, and in another embodiment, each bit is sent after translation 2112. 
The mediod continues until the resource is drawn 2114, 2116. 

VI. Response Generation 

When an application allows a response and ttkt user has a recq)tion conqwnent ciq>able 
of transmitting the response, the user may provide respcmse information to a response collector. 

IS Referring now to Rgure 2B, in one embodiment, each recefMion component 234 is assigned a 
unique code at the time of maimfacture aixl this code is stored in the storage device 224. 
Individual users of the reception component 234 may also be assigned a unique code. When the 
user responds to an object which generates a response, the reception conqx)nent generates a 
response record to allow the response coUectcn* to route the response as described below. 

20 Referring now to Figure 22, one embodiment of a response record 2208 is shown. Long 

word 2210 contains the unique code of the reception component, and long word 2212 contains 
the unique application code sent in the application header. Byte 2214 contains a user identifier, 
to allow the user to distinguish himself from others who may use the reception component. In 
one embodiment, anonymous responses do not contain the reception component or user identifier 

25 2210, 2214 to allow for the user to maintain arK>nymity. Block 2216 contains the defined 

respmse information byte or bytes described above to designate quantity or product information 
according to the user's response. In one embodiment, a passcodc is maintained in the reception 
component, and the user is required to enter it to generate the response to the response collector. 
Referring now to Figure 23, a response networit containing three reception components, 

30 one response collector, axxl two vendors is shown. User reception components 2310, 2312, 2314 
are coupled to response collector forwarding equipment 2316 via communication lines 2311. 
Communication lines 2311 may be permanently coimected or temporarily arranged as needed. In 
one embodiment, conununications lines 2311 are arranged through the public switched telephone 
network when a reception component 2310, 2312, 2314 dials a telephone number of the response 

35 collector. In another embodiment, conununications lines 2311 are cable television cables. Any 
form of conununication, even using an intermediary such as telephone equipment owned by the 
telephone conq>any, will allow operation of the present invention. In one embodiment, response 
collector forwarding equipment 2316 is an industry standard UNIX*based computer system 
coupled to at least one modem to receive and/or transmit data. 
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•nic response coUcctor forwarding equipment 2316 is coupled to vendor ordering 
equipment 2318. 2320 using communication lines 2319 similar to communication lines 2311 to 
allow die response coUector equipment 2316 to leact to the receipt of responses sent by a 
reception component 2310, 2312, 2314 by sending user information and odier mformauon to 
vendor ordering equipment 2318, 2320 as described below. 

Referring now to Figure 24 a method of collecting and sending confidenoal user 
information such as cmdit c«d number to a vendor is shown. Tlie response coUector t,bta.ns 
«er information such as reception component number, user number, name and address, and 
confidential informationsuchascreditcardnumber 2408,2410. In one errtKxhment. tius .s 
accomplished by mail. In another embodiment, this step is accompUshed by telephone. In one 
embodiment, the mformation is verified, for example by checking Ae credit card billing address 
with the address provided by the user 2411. . r .k. 

Tbt response coUector obtains routing information and an application idenufier from the 
information provider 2412. and .s««aies the rooting information with the application identifier. 

The application identifier broadcast to die user as described above and a user reception 
component and user identifier, «e seat to the response collector 2414. Because no confidential 
mformation is sent, nnsecoiecommunic^ion lines may be used to send tte info.^ The 
«ponse collector tiien forwards die user information includmg user confidentud 'nformati«. 
ZZonsc infoim-icm to the vendor .ssca^ with die application identifier received 2416. 



20 This step may be accomplished using a secure taciuty. sucn as n«.i u. '-'^»"'"r*' ^ 
vendorLyLprovide.serviceorpioductstodieusersaddresswidilessUte^^^^ 
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Appendix A 

Hints 

Null 

5 Disable 

Foreground Color 
Background Color 
Border Color 
Border Style 
10 Border Width 
Border Options 

Form Transition Effect (Fade Out, etc.) 
Form Background Gradient Fill 
Clip 
15 Scale to Fit 
Scale 

Text Private (Not seen - use for passwords, etc.) 
Text Numeric 
Text Editable 

20 

Apnearanee of Buttons 

Key 0 

Key 1 

Key 2 
25 Key 3 

Key 4 

Key 5 

Key 6 

Key 7 
30 Key 8 

Key 9 

Key Select 

Key Up 

Key Down 
35 Key Left 

Key Right 

Key Enter 

Key Exit 

Key Cancel 
40 Key Buy 

No Legend 

Keycap Custom 

Keycap Round 

Keycap Square 
45 Keycap Diamond 

Keycap Over 

Keycap Under 

Keycap Left 

Keycap Right 

50 

Curaor Relat^^d Hint^s for Systems with Cursors 

Box (when cursor is inside box, user may press enter) 
No Box (no box needed around object) 
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Highligilt Color 
List Exclusive 
5 List Exclusive None 
List Non Exclusive 
List Horizontal 
List vertical 
List Sort Ascending 

'° ail ?^'trS!°Srfl^=«"» ^"on Which list .croll) 

List Control Down 
List Control Left 
List Control Right 

15 



Timer Random Daring Period 
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Appendix B 

Script Codes 



Stfltaments 



10 



15 



20 



25 



IF 

WHILE 

{function cafl statement) 
RETURN 

{integer aaeignment} 
{string assignment) 
{boolean assignment} 



Token Valua 



0x12 



IfiifiOflL 



{integer variable} 
(string variable} 
(boolean variable} 



(string constant) 
(boolean constant) 



30 



(integer equal) 
(string equal} 
(boolean equal) 
{string compare) 
{is substring) 
AND 
OR 
NOT 



0x10 
0x11 

0x13 
0x14 
0x15 
0x16 



ToKgn Value 



0x20 
0x21 



0x30 
0x31 
0x32 

0x40 
0x41 
0x42 
0x43 
0x44 
0x45 
0x46 
0x47 
0x46 
0x49 



Arguments 



nom 
norw 
none 
none 
rK>ne 
none 

Integer. Integer 
Integer, Integer 
Integer, Integer 
String. String 
Boolean. Boolean 
String, String 
String, String 
Boolean, Boolean 
Boolean, Boolean 
Boolean 



flfltum Yalufl 



Integer 

String 

Boolean 

Integer 

String 

Boolean 

Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 



35 / 

(mod divide) 



40 



45 



(string 

jstrnig extraction} 



finteger object 
(string object 
(boolean obfect 



Dfl»<nitflf» 

(end of string) 

(end of statement Bst) 



) 



0x60 
0x61 
0x62 
0x63 
0x64 

0x70 
0x71 

0x80 
0x61 



} 



0x82 



0x00 
0x01 



Integer, 
Integer, 
integer. 
Integer, 
Integer, 



Integer 
Integer 
Integer 
Integer 
Integer 



Integer 
Integer 
Integer 
Integer 
Integer 



String, String String 
String. Integer. Integer String 

Integer, Integer, Integer Integer 
Integer, Integer, Integer String 

Integer, Integer, Integer Boolean 
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Appendix C 

Predefined Resources 



Navlgatton & System: 20 

5 . Checkmark 

•r 

/ in a bkjs drcto 
Ctoes tcon: down arrow. 
10 • Back amjw:1 80 dagraa loop 

Right Anow: 12 stytot 
Padtock 

Magnifying glass 

PoUs: 4 
IS . Thumbs up 

YES 

Thurrtedown 
NO 

PayfMfitf DsUvsryyOfdsHng: 21 



20 


Visa card 




Mastsrcaid 






Amsrican Exprs 


sscard 




Optima Canl 






Discover card 




25 • 


FedEx Logo 
UPS Logo 
DHL logo 
USPSiogo 






Airtx>meExpm 


tsk)go 


30 • 


Dollar Sign 

Phone 

Fax mach^ 

Coina 

Money bins 




35 . 


Price tag 
Brochure 
Pen & paper 

Envetope 
Stamp 




40 • 


Qrocerycart 





Entsfftatnmont 10 
Television 
Admisskm ticket 
Musical notes 

45 • CD 

Audk) Cassette 

Video Cassette 
fUmstrip 

film camera/projector 
SO • Knife & fork 

Wine bottle & glass 

NesrsAnto: 19 
Watch 
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ClOCfc 

Aiarmdock 
Globe 
USA map 
5 Newspaper 
USteg 
Capitol doine 
stock 0fid 
car 

10 airplans 

van 
train 
bus 
Book 

IS • Calmdar 

Suitcase 
Beakers 

Nudear energy syntel 
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What is claimed is: 

1. An system for routing confidential user information to a vendor comprising: 

a provider component for broadcasting an application identifier to at least one reception 
component; 

S a reception component for storing at least one user identifier, receiving and storing the 

application identifier, assembling user response information, and transmitting to a response 
collector the application identifier received and the user response information assembled; and 

a response collector component for storing the application identifier and vendor routing 
information, associating the af^lication identifier with tht vendor routing information, receiving 
10 the application identifier and user response infcHmation from the reception component, and 

transmitting the user response information to the vendor associated with the application identifler 

received. 

2. The system of claim 1 wherein: 

the reception component is additionally for transmitting at least one user identifier to the 
IS response collector, and 

the response collector is additionally for 

storing at least one user identifier and other user mformation; 
associating at least one user identifier with the other user information; 
receiving the user identifier from the reception component; and 
20 transmitting to the vendor the user information associated with the user identifier 

received. 

3. A method for routing confidential user information to a supplier comprising: 
storing an application identifier and vendor routing information; 
associating the vendor routing information with the application identifier, 

25 receiving an application identifier and user response information; and 

transmitting user response information according to the vendor routing information 
associated with the q^plication identifier received. 

4. The method of claim 3 additionally conqmsing the steps of: 
storing at least one user identifier and other user information; 

30 associating the user identifier and the other user information; 

receiving a uier identifier, and 

transmitting the user information associated with the user identifier received according to 
the vendor routing information associated with the application identifier received. 

5. The method of claim 4 wherein the other user information comprises confidential 
35 information. 

6. The method of claim 4 comprising the additional step of verifying the other user 
information. 



35 



wo 96/34494 



PCTAJS96A)4904 



110 



112 




114 



126 



128 



y 124 



122 



120 



130 



\ 118 



116 



wo 9634494 



PCTAJS9MM904 




Fig. 2B 



wo 96/34494 



PCTAJS96AM904 



2fiS 



270 




2Z2 




2Z4 







2Zfi 



Fig.2C 







Fig. 2D 




wo 96/34494 



PCT/DS96AM904 




Fig. 3 



wo 96/34494 



PCT/US96/04904 



Fig, 4 



410 



412 



I 



414 



I 



R«oaiv» and Oaood* 



416 



Scripts, Convnwids 



418 



420 



± 



A O scod t Dcfinilkjns, 
/ I Sciipt^ Conwnwdi 



422 



I 



Oiiptiy ObjKte, Run 
Scrtoti 



424 



I 



Enoob« and Broadcast 



Raoaiv* and Dacod* 
/\ Updataa 




wo 96/34494 



PCT/US96AM904 




212 



S3A 



SIS 



S20 



522 



Fig. 5 



wo 96104494 



PCT/US96AM904 




fiU 



812 



Fig. 6 



wo 9634494 



PCT/US96A>4904 




W096M494 



PCr/|}S96A>4904 



an 



808 



812 



an 



aifi 



aiz 



818 



F/g.8 



wo 9634494 



PCT/US96/04904 



16 



808 



ai2 



fllfi 



918 



B20 



824 



832 



F/g. 9 



wo 9604494 



PCT/US96/04904 




wo 96/34494 



PCT/US96AM9a4 




Fig. 11 



wo 96/34494 PCTAJS96AM904 



I3/2S' 




1210 



1212 



121i 



121a 



FtQ. 12 



wo 



PCT/US96AM904 



1308 



1214 



121fi 



1318 



1228 



Fig. 13 



wo 9634494 



PCT/US96AM904 



1408 



Jill 



Fig. 14A 




Fig. 14B 




Fig. 14D 



1438 



1440 



mi 



F^g. 14C 



1468 



1478 



US 



1484 




F/g. W 




Fig. 14G 



wo 96/34494 



PCTAJS96A)4904 



/6 



1508 



1S1Q 



1S14 



1S1fl 



Fig, 15 



wo 96/34494 



PCrAJS9<A49M 



1608 



iai2 



F/g. t6 



wo 96/34494 



PCT/DS96AM904 




1718 



^ 



17M 



Fig. 17 A 



Fig, 17B 



wo 96/34494 



PCT/US9MM904 



1810 



1811 



1812 





1830 



1832 



1834 



/ 



Appi 


I 

Oisirid ! 
■Mr. or 

• 

cnon 






Ffiquinqf tnfonnatiQn 


( > 




TumC 
Appictfi 
Fraqtitncy 


ntaror 
9n Using 
dTunad 



1814 




1824 



/ 



1BC 



InfofRiilton SyMiii 



F!g. ISA 



Fig. 18B 



PCT/DS96AM904 



1912 





1920 



1916 



FfQ. 19 



PCTAJS96/IM904 




2010 



2012 



2014 



2016 



2018 



Fig, 20 




Fig. 21 



W09604494 



PCT/US96A4904 



23/2S' 



2208 



2214 



221fl 



Fig. 22 



wo 9634494 



PCT/US96AM904 




Fig, 23 



WOM04494 



PCT/DS96AM904 



Intomation V 

2408 



ConfldwttW 



\ 



2410 



2411 



MbnratiQn 
Numtar 



\ 



2412 



Fig. 24 




2414 



SandUsflnlbfn m ion. 
UMrConfidwitW 
Infonmsion to OidM- 



\ 



2416 



INTERNATIONAL SEARCH REPORT 



No 



PC1/US 96/04964 



A. aASSIFICAIION OF SUUECT MATTEA 

IPC 6 He4N7/173 



(IPO or to 



IPC 



8. F1ELOS SEARCHBD 



IPC 6 He4N 



C DOCUMfiNn GONStDE&fiO TO 18 ULCVAKTr 



No. 



EP.A.e 583 196 (FUJITSU LTD) 16 February 
1994 

see page 5, colum 7« line 18 - page 7, 
column 12, line IS 

see page 8, column 14, line 36 - page 19, 
column 18, line 29 
see figures 3-8,12-lS 



1*6 



m 






11 July 1996 



PttMOOo^ PA sits 
NL-22»HVIUvvi» 

Fob 11-10) M-mC 



Om 



5.08.95 



Van der Zaal, R 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



POCUMBKTS CONSIDEILEP TO M RELEVANT 

of' 



COMPUTER MFTVORKS AND ISDM SYSTgS. 
vol. 26. no. le, I July 1994* AMSTERDAM. 
NL 

SSSaSSI n^iT*T0w5R0S PERSONALIZED 
MULTIMEDIA DIAL-UP SERVICES' 

see page 1396, left-hand col unr, line 5 - 
page 1311. right-hand colianj. line 41 

Vet page 1313. le«-!l«'«*,"^'^ul S ' 
page 1314. right-hand colutm. line W 

see figures 1-3.5 

CABLE TV SESSIONS. MONTREUX, JUNE 19-15. 
1993 

pST^rTELESoN^S MUwES SUISSg. 
p^es 673-677. XPe99379387 ^;TELEH0R«II6 
BY STUDENTS VIA A CABLE TV NETWRIC- 
see the whole document 



No 



PCl/US 96/64994 



No. 



1-6 



1-5 



1 



m— I *m WBI 



page 2 of 2 



DfTERNAlTONAL SEARCH REPORT 



la* M ApiMMDNe 

PCT/US 96/94984 



EP-A-e583196 



16-62-94 



6668889 
6862357 
6862382 
6868891 
6868188 
6153875 



PubfiEUion 



84-83-94 
84-83-94 
84-83-94 
84-83-94 
84-83-94 
31-85-94 



